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SYSTEM AND METHOD FOR MONITORING EFFICACY OF 
WEB-BASED ONLINE BEHAVIORAL CLINICAL STUDY 

BACKGROUND OF THE INVENTION 

5 

Related Applications 

This application claims the benefit of U.S. Provisional Patent Application No. 
60/463,01 6 filed on April 1 5, 2003, the teachings of which are incorporated herein by 
reference in their entirety. 
10 Field of the Invention 

The present invention relates generally to a system and method for evaluating the 
efficacy of web-based online materials. More particularly, a system and method which 
monitors the efficacy of tailored web-based behavioral materials through an online clinical 
study. 

15 Description of the Related Art 

Various online tools have been proposed which provide web based behavioral 
material. For example, materials which assist in smoking cessation. It has been 
determined that smoking cessation through the use of nicotine replacements can be 
further assisted through the use of smoking cessation advice such as written behavioral 

20 materials. 

The behavioral materials often provided consists of brochures or other materials 
which have been determined to assist in smoking cessation. The materials can be 
obtained as printed hard copies or obtainable via the Internet. Such written materials 
often have the limitation of having a one-size-fits-all approach in assisting with the 

25 particular behavior. However, through the advancement of computer technology written 
materials can now be accessed through the Internet from a home computer. Through use 
of the Internet, the written materials provided can be more easily tailored to a particular 
smokers needs and characteristics, such as a customer's age and gender. 

In the instances in which the provided information is tailored to particular 

30 characteristics of a customer, a questionnaire is provided. According to a customer's 

response to the questionnaire, information which has been determined beneficial for such 
characteristics in assisting smoking cessation, will be provided. 

However, once the material has been provided, the efficacy of the material in 
assisting in smoking cessation is not determined. In particular, there is no evaluation or 

35 testing regarding the effectiveness of the information being provided. For example, U.S. 
Application No. 10/230,403 to Byrd et al. discloses a web based online system for 
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monitoring and modifying a behavioral characteristic. However, the effectiveness of 
behavioral materials are not determined through an online clinical study. 

Consequently, if there is for example, behavioral material which a customer has 
determined to be ineffective in assisting smoking cessation, the material being provided is 
5 not subsequently modified based on its effectiveness. Therefore, a customer will be 

consistently accessing and reading provided information which does not assist in smoking 
cessation. Consequently, the behavioral material will again be ineffective and will not 
assist a customer in smoking cessation. 

Attempts have been made to analyze clinical outcomes in for example, chronic 
10 drug therapy. U.S. Application No. 09/872,430 to Reitberg discloses a method of 

evaluating clinical outcomes and providing rational pharmacotherapy in an individual or 
animal requiring chronic drug therapy. However, Reitberg does not disclose online 
capabilities for the clinical study, nor does Reitberg pertain to smoking cessation. 

At the present time, there is no way to gauge the effectiveness of online behavioral 
15 material provided to a customer. The present invention addresses this need. 

SUMMARY OF THE INVENTION 
The present invention addresses the foregoing problems by providing a system 
and method for evaluating the efficacy of tailored online behavioral material in a clinical 
study. 

20 Additionally, there is provided a method of evaluating the efficacy of online tailored 

behavioral material on human subjects comprising conducting a clinical study among 
human subjects, wherein the efficacy of the tailored behavioral materials on the human 
subjects is assessed through online remote interaction. 

In one aspect of the invention, there is provided a method of evaluating the 

25 efficacy of online behavioral material in a clinical study comprising enrolling a plurality of 
customers sufficiently meeting predetermined qualifying requirements for the online 
clinical study, performing a computerized initial evaluation of a customer in order to obtain 
the customer's particular characteristics wherein the initial evaluation is performed during 
a predetermined period of time in the beginning of the online clinical study, and within a 

30 predetermined time of the customers target quit date (TQD), wherein the initial evaluation 
assists in the tailoring behavioral material provided to a customer, randomly segregating 
the plurality of customers into a first group which accesses tailored behavioral material 
online and a second group which accesses non-tailored behavioral material online, 
providing the first group with behavioral material tailored to a particular customer's 

35 characteristics wherein the customer reviews the available behavioral material online 
according to a predetermined plan, providing the second group with non-tailored 

2 



CU60221 

behavioral material generally determined to assist with the behavior under study, providing 
the first group and the second group with a computerized first series of questions after a 
predetermined time in the study, wherein the first series of questions address the 
customer's responses to the behavioral material which has been made available to the 
5 particular customer, providing the first group and the second group with a computerized 
second series of questions after a predetermined time in the study after the first series of 
questions, wherein the second series of questions address the customer's responses to 
the behavioral material which has been made available to the particular customer, 
analyzing the responses of the first group and the second group to the first and second 

10 series of questions according to predetermined factors, and 

evaluating the efficacy of the tailored online behavioral material with the non-tailored 
predetermined online information accordingly. 

Another aspect of the invention provides a system for evaluating the efficacy of 
online behavioral material in a clinical study comprising a host computer of a medical 

15 provider, wherein the host computer comprises a website through which a customer 

registers for an online clinical study, a customer computer, wherein a customer accesses 
the website of the medical provider through the customer computer, a network which 
provides a connection between the host computer and the customer computer, and an 
automated education system housed in the host computer of the medical provider which 

20 provides the customer which tailored behavioral material. 

In another aspect of the invention, there is provided a system for evaluating the 
efficacy of online smoking cessation behavioral material in a clinical study comprising a 
host computer of a medical provider, wherein the host computer comprises a website 
comprising smoking cessation material through which a customer registers for an online 

25 clinical study, a customer computer, wherein a customer accesses the website of the 

medical provider through the customer computer, a network which provides a connection 
between the host computer and the customer computer, and an automated education 
system housed in the host computer of the medical provider which provides the customer 
which tailored behavioral material. 

30 DESCRIPTION OF THE DRAWINGS 

Other aspects and features of this invention will become readily appreciated as the 
same becomes better understood by reference to the following detailed description when 
considered in connection with the accompanying drawings, in which 

Fig. 1 is a generalized schematic block diagram for the system suitable for 

35 implementing an embodiment of the invention; 
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Fig. 2 is a flow chart illustrating a methodology employed according to an 
embodiment the invention for an application such as enabling a person to quit smoking; 

Fig. 3 is an illustration of a first series of computerized questions provided to a. 
customer at a predetermined period in the study to assist in evaluating the efficacy of 
5 material being provided to the customer; and 

Fig. 4 is an illustration of a second series of computerized questions provided to a 
customer at a predetermined period in the study to assist in evaluating the efficacy of 
material being provided to the customer. 

DESCRIPTION OF THE EXEMPLARY EMBODIMENT 

10 Referring to the drawings herein, where like reference numerals refer to like parts, 

there is shown in Fig. 1 a system consistent with the present invention to provide a 
specific customized or tailored plan for modifying a behavioral characteristic and 
evaluating the effectiveness of the tailored online material in a clinical study through 
remote interaction between the customer and the medical provider. The system is 

15 particularly suited for facilitating smoking cessation. To achieve that end, the system 
periodically assesses various groups of customers to determine any changes in their 
smoking characteristics as a result of materials they have viewed and received online. 
The assessments are subsequently gathered and analyzed in order to determine the 
efficacy of the tailored materials. 

20 Consistent with an exemplary embodiment of the invention, the customer 

purchases the designated smoking cessation product such as a nicotine replacement. A 
brochure is enclosed with the product which provides information on the product and 
general information on the benefits of quitting. However, if the customer desires further 
behavioral material, further material can be requested via telephone or online. 

25 For example, a customer can contact the provider of the behavioral material via 

telephone and request additional printed information. As another option, the customer can 
participate in an online clinical study where behavioral materials will be provided online. 

In the situation where a customer desires to access behavioral material online, the 
customer 3 accesses the website 4 of a medical provider 1 via the customer's personal 

30 computer. A connection is established between the customer 3 and the medical provider 
1 through a communication network 2. Upon accessing the website 4 of the medical 
provider, the customer is given information regarding the study, for example, the length of 
the program, the desired goals of the study, the time required of the customer, and 
compensation to be provided to the customer for the customer's time. A customer can 

35 then determine whether the customer would like to participate in the online study. The 

study will be approximately 10 months however, a customer's participation in the study will 

4 



CU60221 

be approximately 1 2 weeks, 1 0 weeks of which the customer will be provided behavioral 
material. 

The process of conducting the clinical study is disclosed in Fig. 2. 
If a customer decides to participate in the study, the customer must register online 
5 at a designated website (S10). The website can be accessed from any computer such as 
the customers home computer. Certain qualifying requirements are imposed for 
participation in the online study. When the customer indicates that the customer would 
like to participate in the study, a qualifying computerized evaluation, which is housed in 
the automated education system 5 of the medical provider, will be performed (S20). 

10 Exemplary, non-limiting, qualifying criteria for a smoking cessation program include 

that the customer be 18 or older, smoke more than 10 cigarettes a day, have purchased 
the nicotine replacement product, have a valid email address and internet access for the 
duration of the study, have a target quit date (TQD) during a qualified time for the study, 
and agree to computerized assessment at predetermined times throughout the study. The 

1 5 customer must also verif iably purchase the nicotine replacement product. 

Customers who are not currently smoking (have not smoked within 7 days of 
enrollment in the study), are using the nicotine replacement for a purpose other than 
quitting smoking, use other tobacco products such as smokeless tobacco, are using other 
pharmacological treatments for smoking cessation, and are using other behavioral 

20 treatments for smoking cessation would not qualify for the online study. If the customer 

meets the requirements of the qualifying evaluation, further questions will then be asked of 
the customer. If the customer does not meet the requirements of the qualifying 
evaluation, the customer will be informed that the customer cannot participate in the 
clinical study. 

25 Once a customer has been deemed to qualify for the study, and the customer 

agrees to participate in the study, information regarding the study will be provided in detail 
and the customer must sign an informed consent documenting their understanding and 
willingness to participate in the study (S30). Verification will also be performed to ensure 
that the customer meets the qualifying criteria. 

30 Consistent with an embodiment of the invention, once the customer has been 

determined to qualify under the qualifying evaluation, prior to or a week after a target quit 
date (TQD), which is the date on which a customer will quit smoking, an initial evaluation 
will be performed (S40). The initial evaluation questions the customer on for example, the 
customers' demographics, smoking history, health history, health behaviors related to 

35 smoking, motives for quitting, and expected difficulties in quitting. The system relies on 
self-reporting by the customer due to the difficulty of information verification through the 
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computer system. It has been determined that verification of such information will have 
little impact on the accuracy of the study. 

Among those that register online, through a random selection, a predetermined 
number of customers who qualify will be placed in a group given tailored online behavior 
5 materials (S50). The group selected for the tailored online behavioral materials, will be 
called the CQ2 group. Those that are not placed in the CQ2 group, will be placed in the 
control group. The placement of customers will be based on a random selection through a 
computer algorithm until a predetermined number of customers are registered for each 
group. The efficacy of the plan applied in the clinical study is determined according to a 
* 10 comparison of the CQ2 group and the control group. Customers are continually enrolled 
in the study until a predetermined number of customers determined sufficient for testing, 
analyzing and comparing the efficacy of the tailored behavioral material, have been 
enrolled in the study. 

The participants will be informed after a predetermined period of time, for example 

15 24 hours, after responding to the initial evaluation, as to which group, either the CQ2 
group or the control group, they will be placed. The customers will also be informed of 
their ability to withdraw from the study at any given time. If a customer withdraws from the 
study, the customer will not be counted for the predetermined number of candidates 
desired for the CQ2 group or the control group in which the customer was designated. 

20 Once the customers have been placed in their respective groups, behavioral 

materials will be accordingly provided. The CQ2 group will be provided, through the 
Internet, comprising a tailored plan for the duration of the study, three sequential tailored 
newsletters and tailored behavioral support emails (S60). The newsletters will be 
provided for example, 2, 21 and 38 days after the customer's TQD. E-mail support will be 

25 provided throughout the entire duration of the program to for example, provide 
encouragement and help in relapse prevention at 7, 14, 30 and 54 days after the 
customer's TQD. 

The tailored information can include information regarding the customers 1 
demographics, smoking history, health history, health behaviors related to smoking, 
30 motives for quitting, and expected difficulties in quitting. The tailored behavioral material 
is continually available to the customer at any time. The customer should regularly review 
the materials in order to be assisted in quitting smoking. 

The control group will be given online material which is not tailored to particular 
characteristics of the participants (S70). Such information can include general information 
35 on the addictive effects of nicotine, symptoms caused by smoking, health benefits of 
quitting, information on the nicotine replacement product and how the nicotine 
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replacement will assist the customer in quitting, a diary to document their emotions and 
cravings, and a calculation of money saved if they quit smoking. 

A customer will be evaluated at designated periods during the study, for example, 
6 weeks and 12 weeks from the customer's TQD. The customer will be given 2 weeks 
5 from their 6 and the 12 week date to complete a series of computerized questions. 

At for example, the 6 week period, the customer is prompted to respond to a first 
series of computerized questions as illustrated in Fig. 3 (S80). The series of questions 
assess compliance with the appropriate use of the nicotine replacement product, 
compliance with continual use of the nicotine replacement product, the degree of 

10 personalization of the materials which have been tailored for the first group, the 
helpfulness of the tailored materials, the customer's satisfaction with the tailored 
behavioral materials, and the customers interest in participation in further studies. At for 
example, 10 weeks after a customer's TQD, at which point the customer has continually 
viewed the respective provided material, the customer will be given a letter indicating that 

15 the customer has completed the program (S90). The customer will again be requested to 
respond to a second series of questions, similar to the first series of questions, but at for 
example, a 12 week period as illustrated in Fig. 4 (S100). 

A customer of the CQ2 group who successfully completes the program and stops 
smoking, will be given a congratulatory letter which is tailored to the particular customer. 

20 If the customer does not successfully quit smoking they will be provided with a relapse 

letter tailored to the reason for their relapse and will be provided encouragement to try the 
program again. 

Responses of the CQ2 group and the control group are subsequently collected 
and analyzed in order to determine the efficacy of the online behavior material (S1 10). 
25 The success rates of customers according to for example, gender, age, quantity of 

cigarettes smoked her day, length of smoking, and various other characteristics can be 
evaluated to determine the effectiveness of the tailored material for particular customers. 

Areas of evaluation include subjects who receive their behavioral support materials 
by logging onto an internet site and activating their account, subjects who respond to the 
30 6-week assessment, subjects who withdraw after they access their behavioral support 
materials but do not respond to the 6-week assessment, and subjects who did not 
response during the 6 week assessment but respond to the 12 week assessment. 

If both the CQ2 group and the control group have the same responses, it could be 
determined that the online material is not more effective that the material being provided 
35 to the control group. However, if the CQ2 group has a greater number of consistent 

smoking quitters, it can be determined that the tailored online material being provided is 
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effective for smoking cessation. The efficacy of the tailored online will also be determined 
according a continuous abstinence of smoking by the customer and by a seven day point 
of prevalence test in which the customer reports that the customer has not smoked for 
seven days preceding the assessment. 
5 The personal opinions of the customers regarding the effectiveness of the 

behavioral material, obtained at S80 and S100, can also be used as a basis of analyzing 
the effectiveness of the behavioral material. In addition, the effectiveness of the 
behavioral material can be determined according to a mathematical analysis based on 
smoking cessation rate reflected in the customers responses at S80 and S100. Additional 
10 analysis methods will be known to those who practice in the field. 

The present invention may be embodied in other forms without departing from the 
scope of the present invention. The described embodiments are to be considered in all 
respects only as illustrative and not restrictive. All changes which come within the 
meaning and range of equivalency of the claimed are to be embraced within their scope. 
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